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' Abstract 

^SJ , In this paper we derive strong linear inequalities for sets of the form 

O ! {{x,q) eR'' xR : q> Q{x), x eR'' - int(P) }, 

. where Q{x) : R** ^ R is a quadratic function, P C R'' and "int" denotes interior. Of particular but not 

exclusive interest is the case where P denotes a closed convex set. In this paper, we present several cases 
where it is possible to characterize the convex hull by efhciently separable linear inequalities. 



^ ; 1 The positive-definite case 

o 



> 

o 



We consider sets of the form 

S = {{x,q) eR'^ xR : q>Q{x), x e R'^ - int(P) }, (1) 



where Q{x) : R — ?> R is a positive- definite quadratic function, and each connected component of P C R is 
a homeomorph of either a half-plane or a ball. Thus, each connected component of P is a closed set with 
nonempty interior. 

Since Q{x) is positive definite, we may assume without loss of generality that Q{x) = ||a;|p (achieved via 
a linear transformation). For any y £ M.'^, the linearization inequality 

q > 2y'^{x~y) + \\yf = 2y'^x - \\yf (2) 

, is valid for all (x, q) G M"* x M. We seek ways of making this inequality stronger. 

CN ■ 

Definition 1.1 Given eR"^ and R> 0, we write B{^i, R) = {x £R'^ : \\x- < R}. 

1.1 Geometric characterization 

Let X e R'^. Then a; G R'^ - int(P) if and only if 

\\x-^i\\^>p, for each ball C P. (3) 



In terms of our set S, we can rewrite ([3]) as 

q > 2n'^x - II ^11 2 + p, for each bah B{fi, ^p) C P. (4) 

On the other hand, suppose 

Sq - 2/3^x > (5) 

is valid for S. Since R'' — P contains points with arbitrarily large norm it follows 6 > 0. Suppose that 6 > 0: 
then without loss of generality (5=1. Further, given x G R"^, (O is satisfied by {x,q) with q > ||a;|p if and 
only if it is satisfied by (a:, and so if and only if we have 

\\x-pr> wf^r+Po- (6) 

Since (O is valid for S, we have that ([6]) holds for each x G R'^ — int(P). Assuming further that ([5]) is 
not trivial, that is to say, it is violated by some (z, llzjp) with z G int(P). wc must therefore have that 
||;3||2 + /3o > and B{i3, ^jj^P + /3o) C P, i.e. statement © is an example of ©. Below we discuss several 
ways of sharpening these observations. 
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1.2 Lifted first-order cuts 

Let y e dP. Then we can always find a ball y^) C P such that — — p, possibly by setting ^J^ — y 
and p = 0. 

Definition 1.2 Given y G 3P, we say P is locally flat at y if there is a ball B{fi, -^/p) C P with \\fj, — y\\'^ = p 
and p > 0. 

Suppose P is locally flat at y and let B{p,, y/p) be as in the definition. Let a'^x > ao be a supporting 
hyperplane for B{p, y/p) at y, i.e. a'^y = uq and a^x > uq for all x £ B{p, ^/p)■ We claim that 

q > 2y'^x - \\yf + 2a{a^x - ao) (7) 

is valid for 5 if a > is small enough. To see this, note that since a'^x > ao supports B{fj., yfp) at y, it 
follows that fj. — y ~ aa for small enough, but positive a, i.e.. 



Biy + aa, V^^) = B{p,^p). (8) 
Now, assume a <a. Then {v, violates ^ iff 

< 2y'^v - \\y\\^ + 2a{a^v-ao) (9) 

= 2{y + aafv - ||y + aa||^ + a^\\a\\'^ + 2a[y^ a ~ ao) (10) 

= 2{y + aa)^v - ||y + aa|p +a^||a|p, that is, (11) 

z; e S(2/ + aa , V^^^Rp) C 6(/i, Vp) (12) 
since a < a. In other words, for small enough, but positive a, ^ is valid for S. 

In fact, the above derivation implies a stronger statement: since a^.T > oq supports S(y + aa , ^a^ljajp) at 
y, for any a > 0, it follows ([7]) is valid for 5* iff B{y + aa , ^a^Hajp) C P. Define 

a = sup{ a : (O is valid}. 

If there exists v ^ P such that a'^v > ao then the assumptions on P imply that a < +oo and the 'sup' is a 
'max'. If on the other hand a'^v < ao for all u ^ P then a = +oo (and, of course, a^x < ao is valid for 5*). 
In the former case, we call 

q > 2y'^x ~ \\yf + 2a{a^x - ao) (13) 

a lifted first-order inequality. 
Theorem 1.3 Any linear inequality 

Sq - P'^x > Po (14) 

valid for S either has 5 ~ Q (in which case the inequality is valid for ^ P), or 5 > and ^4\ ) dominated 
by a lifted first- order inequality or by a linearization inequality (0). 

Proof. Consider a valid inequality (|14p . As above we either have (5 = 0, in which case we are done, or 
without loss of generality 5 = \, and by increasing /3o if necessary we have that (jl4p is tight at some point 
(y,||y||2)€K'ixR. 
Write 

P'^x + Po = 2y^a; - + 27^x + 70, (15) 

for appropriate 7 and 79. Suppose first that y G int(M'' — P). Then (7,70) = (0,0), or else (fT4|) would not 
be valid in a neighborhood of y. Thus, is a linearization inequality. 
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Suppose next that y e dP, and that ([M]) is not a linearization inequality, i.e. (7,70) 7^ (0,0). We can write 
(HI) as 

q > 2y^x - \\yf + 2j^x + 70 

= 2(y + 7)^x- ||y + 7||2-27^y- II7II2+70. (16) 

Since (|14p is not a linearization inequality, and is satisfied at {y, ||t/jp) there exist points {v, ||u|p) (with v 
near y) which do not satisfy it. Necessarily, any such v must not lie in M'' — P (since is valid for S). 
Using (|16p this happens iff 

\\vf < 2{y + jfv~\\y + jf-2j^y^\\j\\^+jo, that is, (17) 
V e int(^6(^y + 7, y^2^^J^^~f^^+^^ (18) 

In other words, the set of points that violate (|14p is the interior of some ball B with positive radius, which 
necessarily must be contained in P. Since (y, ||j/|p) satisfies p4p with inequality, y is in the boundary of 
Thus, P is locally flat at y; writing a^x — gq to denote the hyperplane orthogonal to 7 through y, we have 
that p4| is dominated by the resulting lifted first-order inequality. ■ 

1.3 The polyhedral case 

Here we will discuss an efficient separation procedure for lifted first-order inequalities in the case that P is 
a polyhedron. Further properties of these inequalities are discussed in [TU] . 

Suppose that P = {x G M'* : afx > bi, 1 < i < m} is a full-dimensional polyhedron, where each 
inequality is facet-defining and the representation of P is minimal. For 1 < i < to let i/^ = { a; S M'' : afx = 
bi}. For i j let H{i,j} = { a; S M'' : afx = 6^, ajx = bj}. is [d — 2)— dimensional; we denote by LOij 

the unique unit norm vector orthogonal to both Hij and (unique up to reversal). 

Consider a fixed pair of indices i ^ j^ and let € int(P). Let riij be the 2-dimensional hyperplane 
through fx generated by and ujij. By construction, therefore, is orthogonal to H{i.j} and is thus the 
orthogonal complement to H{ij} through /i. It follows that ilij = Vlji and that this hyperplane contains the 
orthogonal projection of /x onto Hi (which we denote by 7ri(/x) and the orthogonal projection of fi onto Hj 
{■Kj{fi), respectively). Further, H H^ijj consists of a single point k^i jy{fj,) satisfying 

IIm - = 11m - 7r»(M)|P + ||7r,(/i) - %,j}(pi)f 

= !|M-^,(M)ll' + lk,(/i)-%,)(M)f. (19) 

Now we return to the question of separating lifted first-order inequalities. Note that P is locally flat at a 
point y if and only if y is in the relative interior of one of the facets. Suppose that y is in the relative interior 
of the i*'' facet. Then the lifting coefficient corresponding to the lifted first-order inequality at y is tight at 
some other point y in a different facet, facet j, say. Thus, there is a ball B{fi, ^p) contained in P which is 



tangent to Hi at y and tangent to Hj at y, that is to say, 

y = 7rj(/i) and y = TTjifi), (20) 

y — k[ijj{i-i) is parallel to cj^ and y — k^i jy{p) is parallel to ujji, (21) 

Wfx-yf = \\fi-yf = p, and by dm), (22) 

l|y- = l|y - %j}(/^)ll, and (23) 

Ui-y\\ =tan0||y-fc{,,jj(/i)||, (24) 



where 2(/) is the angle formed by and uiji. By the preceding discussion, p = d'^||ai|p; using (|22p and ([M)) 
we will next argue that the lifting coefficient, d, is an afiine function of y. 

Let ^.j (1 < 5 < d — 2) be a basis for { a; G M'' : afx = ajx = 0}. Then a^, together with ujij and the 

/i? o form a basis for M.'^. Let 

• Oi be the projection of the origin onto Hi - hence Oj is a multiple of Oj, 
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• Ni be the projection of Oi onto H{ij}- 
We have 

y = 0, + {N,-Oi) + (fc{,,,}(/.) -Ni) + {y~ /c{,^,} (/i)), (25) 
and thus, smee Ni — Oi and y— k^i j-^lp,) are parallel to ujij, and fc{j — Ni and Oi are orthogonal to uJij, 
ujf^y ^ ijf^{N,-0,)+^f^{y~k[,^jy{fi)) = ^,^(iV, - O,) + ll^ulllll/ - (26) 

or 

\\y-ki^M\\ = M'WAy-^'^ + o^)■ (27) 

Consequently, 

p tan ( 



tan( 



|y-%,}(M)ll (28) 



uj,,r'ujf^{y-N, + 0,). (29) 



a?: 



We will abbreviate this expression as pijy + qij. Let x* e M'*. The problem of finding the strongest possible 
lifted first-order inequality at a;* chosen from among those obtained by starting from a point on face i, can 
be written as follows: 

min -2y^a:* + ||t/||^ - 2Q!(a^a;* - ao) (30) 
s.t. yeP (31) 
ajy = h (32) 
< a < pijy + qij \f j ^ i. (33) 

This is a linearly constrained, convex quadratic program with d + 1 variables and 2m — 1 constraints. By 
solving this problem for each choice of 1 < i < m we obtain the the strongest inequality overall. 

1.3.1 The Disjunctive Approach 

For 1 < i < TO let = { a; e M'' : ajx < 6J; thus R'^ - P = [j- P\ Further, for 1 < i < to write: 

Q' = { {x,q) eW^ X R : afx <bi, q> \\xf}. 

Thus, (x*, q*) G conv(5) if and only if {x* ,q*) can be written as a convex combination of points in the sets 
Q*. This is the approach pioneered in Ceria and Soares [5] (also see [13] )• The resulting separation problem 
is carried out by solving a second-order cone program with to conic constraints and md variables, and then 
using second-order cone duality in order to obtain a linear inequality (details in |10]). 

Thus, the derivation we presented above amounts to a possibly simpler alternative to the Ceria-Soares 
approach, which also makes explicit the geometric nature of the resulting cuts. 

1.4 The ellipsoidal case 

In this section we will discuss an efficient separation procedure for lifted first-order inequalities in the case 
that P is a convex ellipsoid, in other words, 

P ^ {x em.'^ : x^Ax - 2c^x + b < 0}, 

for appropriate AyO,c and b. The separation problem to solve can be written as follows: given(a:*, 5*) G 

max{ 8(p) : p > 0} where, for fixed p>0, (34) 
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Q{p) ^ nm-x p — {q* - 2fi^x* + ^'^ p) = p - \\x* — fiW"^ - q* + \\x*\\'^ 
s.t. peR'\ p>0 and B{n, ^p) C P 

Consider a fixed value p > 0. We will first show that with this proviso the condition 

Bill, ^) CP 



(35) 
(36) 

(37) 



is SOCP-rcprcsentable. We note that [T| considers the problem of finding a minimum-radius ball containing 
a family of ellipsoids; our separation problem addresses, in a sense, the opposite situation, which leads to a 
somewhat different analysis. Our equations (pn|) - (PT|) are related to formulae found in [T] (also see [7]) but 
again reflecting the opposite nature of the problem. Also see [4] . Some of the earliest studies in this direction 
are found in [8]. 



Returning to ([37]), notice that this condition is equivalent to stating 

~ p > 0, y X s.t. (x + p,)'^A{x + p) - 2c^{x + p) + b > 0. 



(38) 



Using the S-Lemma [M], [TT], [2], ([38)) holds if and only if there exists a quantity 9 > such that, for all 

x eR'^ 



x^ {I - OA) X + 20{c^ ~ p^A)x + e{-p^Ap + 2Jn 



P > 0. 



Clearly we must have 6 > Q\ writing t = 6 we have that ([55)) holds if and only if there exists r > such 
that 



x'^ (l - -A] X + -{J - p^A)x + -{-fi^Afj. + 2jp - 6) - p > Vx 



T T 

Let the eigenspace decomposition oi Ahe A = UAU^ and write 

y = U'^x, and v — v{p) U'^ (c — Ap,). 
Then we have that ([39]) holds iff for all y eW^, 



(39) 



1 



1 



y' [I - -A]y + -v'y + -{-p' Ap + 2c' p 



P > 0, 



or, equivalently, 



\ 



>- 0. 



(40) 



V ^v'^ i(-p^^P + 2c^p -b) - pj 
Let Xmax denote the largest eigenvalue of A. Then ([^ holds iff r > Xmax, and 

1 1 

E 1 W- + -(-'"^^'" + -b) - p>0, 

1 — Ai/r T 



or, equivalently 



d 2 



V — p^ Ap + 2c^/i - 6 - pT > 



(41) 



which is SOCP-representable. Formally this is done as follows: ([^T]) holds iff there exist quantities j/j, 
1 £ J < such that 

d 

- ^i) > ""i > 1 < j < cf, and - ^ - /i^^p + 2c^ p - 5 - pr > 0. (42) 
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In summary, then, for fixed p the problem of finding the most violated lifted first-order inequality can be 
formulated as the following SOCP, with variables /i, r, v and y: 

min 2^jL^x* + p^ p + q* - p (43) 
s.t. v = U'^{c-Ap,) (44) 

T > Xmax (45) 

yj{T~Xj) > vl l<j<d, (46) 
d 

-^Vj + 2c^P - b - pr > p.'^Afi. (47) 

Here, constraints and (|47p are conic (in (|^7|) . it is critical that p is a fixed value, since r is a variable). 

Lemma 1.4 Let K he an arbitrary convex set and v £ K . For p > the function 

N{p) = min||w — /.t|p 
s.t. Bip,y^)CK, (48) 

is convex. 

Pending the proof of this result, we note that as per eq. ((35|) . if A ^ then Q{p) is a concave function of 
p. Thus the separation problem can solved to arbitrary tolerance using e.g. golden ratio search, with the 
SOCP (|121)-(|171) as a subroutine. 

Proof of Lemma \l.Ji\ To prove convexity of iV, it suffices to show that for any pair of values pi ^ p2 there 
exists a function g{p) such that 

(a) g{p,)^N{pi), i-1,2, 

(b) g{p) > N{pi) for every p between pi and p2, 

(c) g{p) is convex between pi and p2- 

Thus, let pi,p2 be given. For i = 1,2 let pi = aigimnN^pi) and Ri = y/pi- Assume without loss of 
generality that Ri < R2. Let < A < 1. Since K is convex. 



B{ (1 - \)pi + Xp2 , V((l-A)i?i+Ai?2)2 ) C K, (49) 

in other words, for any point p in the segment [pi,p2], there is a ball with center contained in K and 
with radius 

+ (50) 
\\P2 - Mill 

or, to put it even more explicitly, as a point p moves from pi to p2 there is a ball with center p contained 
in K, whose radius is obtained by linearly interpolating between Ri and R2 . Let p* be the nearest point 
to V on the line defined by pi and p2 (possibly p* ^ K). For i = 1,2, let ti = \\p* — pi\\. 

Suppose first that p* is in the line segment between pi and p2 and p* =/= pi. By (j49p there is a ball 
centered at p and contained in K with radius strictly larger than Ri, a contradiction by definition of pi. 
The same contradiction would arise if p2 separates p* and pi. 

Thus pi separates p* and p2. Defining 

s = — > 0, (51) 

12 — tl 

we have that for —ti < t < t2 — 2ti the point 

Kt) = Ml + 7^^(^ + ti) (52) 
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lies in the segment [fii , ^2] and is the center of a ball of radius 

R{t) = Ri + s{ti + t); (53) 

further fi(—2ti) = /z*. Since K is convex, the segment between v and /i2 is contained in K; let w be the 
point in that segment with \\v — w\\ = \\v — /ii||; by the triangle inequality 

\\fi,-fl2\\>\\w-fl2\\. (54) 

Let TT be the slope of the linear interpolant, between values R* and R2, along the segment [w,/i2], i-c 
R* + Tr\\v — ii2\\ = R2- Then, as previously, B{w, VRw) ^ K where Rw = R* + ttWv — w\\ . But then it follows 
by definition of fii that 

R^<Ri. (55) 
By ([55]) and ([5^ . we have tt > s, and therefore, by ([55]). 

Ri > R* + tt\\v-w\\ = R* + 7r||w-^i|| > R* + 7r||^*-^i|| > sti, (56) 
Now, for any t, since fi{—2ti) = /i*, 

t2 — II 

Define 7 = (^2 - Mi)/(i2 - ii),and 

9{p) = 7 ( — ^ + h 

We will prove that g satisfies properties (i)-(iii) listed above. For p between pi and p2, writing R = and 

i = [R- Ri)/s~ti, 

it follows that yu(t) is the center of a ball of radius R contained in K . Further, since \\p{t) — p,*\\ =7|t + 2ii|, 

gifi) = \\^i{t)-^^*f + (58) 

and so g satisfies (i) and (ii). Finally, to see that g is convex, note that the coefficient of ^/p in the expansion 
of g{p) in ([58|) equals 

2.= (|-41)S0. (») 

by dlS]). ■ 

Note: We speculate that A>Q (i.e., convexity of P) is not required for Lemma [1.41 and that further the 
overall separation algorithm can be improved to avoid dealing with the fixed p case. 

2 Indefinite Quadratics 

The general case of a set { (x, g) S M'' x R : q> Q{x), a; € M'' — int(P) }, where Q{x) is a semidefinite 
quadratic can be approached in much the same way as that employed above, but with some important 
differences. 

We first consider the case where P is a polyhedron. Let P ~ {{x, w) E ]R'^+^ : afx — w<bi, I < i < m} 
(here, w is a scalar). Consider a set of the form 

S = {{x,w,q) eR''+^ : q>\\xf, {x,w) eR'^+^ - P} . (60) 




7 



Many examples can be brought into this form, or similar, by an appropriate afHne transformation. Consider 
a point {x*,w*) in the relative interior of the facet of P. We seek a lifted first-order inequality of the 
form 

{2x* — aaif" X + aw + ahi — \\x*\\^ < q, 
for appropriate a > 0. If we arc lifting to the j*'' facet, then we must have = abi — \\x*\\'^, where 

min \\x\\'^ — {2x* — aai)'^ X — aw (61) 



s.t. ajX — w^bj. (62) 

To solve this optimization problem, consider its Lagrangian: 

C{x, w, v) — \\x\\'^ — {2x* — aaiY' X — aw — i'(ajx — w — bj) 

Taking the gradient in x and setting it to 0: 

VxC = <^ 2x-2x* + aai - va,j = 
<i=> X ^ X fli H — a 



Now doing the same for w: 



2"' ■ 2^^' 



<^ ly = a 



Combining these two gives 

^ a a 



X - -a, + -aj 



then using the constraint aj x ~ w = bj gives 



T * 7 " T a rp 
w ~ Gj X — bj — —Uj tti + —aj aj 

Next we expand out the objective value using the expressions we have derived for x and w, and set the result 
equal to abi — \\x*\\'^. Omitting the intermediate algebra, the result is the quadratic equation 

a{ajx* — bi ~ {ajx* — bj j) — —a'^{afai — 2afaj + ajaj) = 

One root of this equation is a = 0. The other root is 

„ ^ A{afx*-h~iajx*-b,)) 

a — rp n T , T ■ V""^/ 

ai - 2al + aj aj 
Since aJx* — w* = bi, and OjX* — w* < bj, we have 

afx* - b, - {aJx* - bj) > 

so d > (the denominator is a squared distance between some two vectors so it is non- negative). Moreover, 
the expression for a is an afEne function of x* . Thus, as in Section 11.31 the computation of a maximally 
violated lifted first-order inequality is a convex optimization problem. 

In this case there is an additional detail of interest: note that the points cut-off by the inequality are 
precisely those of the form {x, w, ||a;p) such that 

{2x* - aai)^x + aw + ah, - > \\x\\'^ . (64) 

This condition defines the interior of a paraboloid] this is the proper generalization of condition (jS]) in the 
indefinite case. 
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